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CROSS REFERENCE TO RELATED APPLICATION 

This application claims priority to U.S. 
provisional S.N. 60/117,273 filed Jan. 26, 1999, 
10 incorporated herein by reference in its entirety. 

FIELD OF THE INVENTION 

This disclosure relates to video and more 
specifically, to carrying data with a video signal so 
15 the data is not recorded by standard video recorders. 

BACKGROUND 



3 The present inventors have recognized that it is 

-A 

desirable to have the ability to modify video signals 



20 so they carry additional information (data) which can 
be received and used by a receiving device (e.g., a TV 
set or display device but which, for security reasons, 
is not recordable by standard video recorders. It is 
believed that this problem of video data conveyance 

25 without recordability has not been earlier recognized. 
For instance, the VBI (vertical blanking interval) of 
video signals is often used to carry (non-video) data 
such as closed captioning, but a standard VHS type VCR 
does record the VBI and also this data. However, 

30 current digital video recorders do not record the VBI, 
and it is believed that future digital recorders may. 
record only, for instance, part of the amplitude of the 
VBI . 
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SUMMARY 

There is disclosed here how to place data in that 
part of video signals which will generally survive 
5 transmission to a receiving device (e.g., transmission 
across a coaxial cable) but which will not be recorded 
by certain classes of current or standard video 
recording or storage devices. The data is used by non- 
recording devices, such as a compliant (compatible) TV 
10 set, for instance, for control or descrambling of the 
video signal. This approach is not limited to any 
O particular video or TV standards. 

=1 

•:3 BRIEF DESCRIPTION OF THE DRAWINGS 

Q 

?q 15 Fig. 1A shows a generic system for play of 

scrambled analog video. 

Fig. IB shows the generic system of Fig. 1A with 
j =3 recording which demonstrates the technical problem of 

f[j problematic record/play devices. 

2 0 Fig. 1C shows a non-problematic recording system. 

O 

q Fig. 2 shows a prior art video waveform. 

Fig. 3 shows a modified vertical blanking interval 
(VBI) waveform. 

Fig. 4 shows another modified VBI waveform. 

2 5 Fig. 5 shows a conventional video encoder. 

Fig. 6 shows a modified video encoder. 
Fig. 7A shows a frequency spectrum for data 
placement . 

* Figs. 7B and 7C show, respectively, an encoder and 

3 0 decoder to carry out the Fig. 7A method. 

Figs. 8A, 8B and 8C show sync modulation for data 
placement . 
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DETAILED DESCRIPTION 

ACertain video (e.g., television) systems, 
inclucfling scrambling systems, pass data, either in the 
clear c^r encrypted, in the vertical blanking interval 
5 of the v\cieo signal. (This data is usually not a part 
of the viafeo image or necessary for the video image.) 
For an example, see co-pending and commonly owned U.S. 
Patent application to Ryan, et al . , "Method and 
Apparatus for^crambling a High Definition Television 

10 Signal," S.N. \ , filed January 14, 2000, 

Attorney Docket Wo. M-8137 US, incorporated herein by. 
reference in its Entirety . 

Systems using encryption in this case rely on the 
receiving device to have a unique key decryption 

15 technique. In applications with consumer electronic 

equipment, management of these keys for a large number 
of devices causes significant cost to be incurred. In 
many cases, a system with lower, but sufficient, 
security could be created with a small number of reused 

2 0 keys. 

To provide benefit to the copyright holder (this 
refers to the copyright on the video content) , it may 
be desirable to discourage recording of certain types 
of video content from a video player or set top box. 

2 5 Fig. 1A shows the desirable connection where video 

player or cable-TV set top box 14 scrambles its output 
video and provides the descrambling key while compliant 
display (TV set) device 18 descrambles the video for 
display. 

3 0 As shown in related Fig. IB, without the present 

method, while device 14 can scramble the video, the 
video can still be recorded and additional copies made 
using multiple record/play devices (such as device 13) . 
Each of these copies can be played on (recorder) device 
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13 and viewed on display device 18. This is 
undesirable from the copyright holder's viewpoint and 
is activity which the present method discourages. In 
Fig. IB, non-compliant (problematic) devices such as 
5 device 13 record the video and its vertical and/or 

horizontal blanking intervals. By recording the entire 
video stream including the descrambling keys designated 
in Fig. 1A as "scrambled analog video with data", 
device 13 is problematic to the copyright holder. The 
10 resulting video recording would then still be playable 
on a non-compliant (problematic) playback device 13 (a 

Q video recorder) and the played signal, shown in Fig. IB 

as "scrambled video with data", would still be viewable 

! *3 on a compliant display device 18 as shown in Fig. IB. 

.;i 15 Hence this disclosure is directed to methods and 

W apparatuses for concealing or hiding data (such as 

decryption or descrambling keys) in a video signal so 

O that the hidden data is not recorded by such a 

problematic standard (non- compliant) video recorder. 

tni 2 0 That is, only special (compliant) video receivers or 

^ recorders can extract and use the hidden data. This 

approach is not limited to high definition television 
(HDTV) , as disclosed in the above -referenced co-pending 
application, but generally applies to situations using 
25 analog video transmission with digital video 

storage/recording. The method (in that co-pending 
application) for high definition television in which 
an indicator of the amount of wobble (active video time 
shifting for scrambling) is conveyed as hidden data by 
30 shifting in a predetermined fashion a location (in 

time) of an edge of a sync pulse is one example of this 
approach. The shifted sync pulse edge position 
represents an encoded version of the "hidden" data. 
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More generally, this approach is useful when it is 
desired to control use (e.g., recording or display) of 
the video signal upon receipt, and especially where the 
intent is that the control data (which is the "hidden" 
5 data) itself is not readily recordable by a problematic 
(non- compliant) standard video recorder. 

As shown in Fig. 1C (similar to Fig. IB), many 
types of current standard NTSC and PAL video 
record/play devices 12 blank the vertical and 
10 horizontal blanking intervals of a scrambled analog 
video signal output from a compliant video player or 
□ set top box (source) 14. This has the advantage of 

"5 automatically thereby removing any associated hidden 

Q data located in the blanking interval . In the case 

:=S 15 shown in Fig. 1C, the scrambled analog video without 
^ scrambling data transmitted from the non-problematic 

*' record/play device (recorder) 12 to the display device 

O 18 (TV set) is thereby unable to be descrambled. This 

j>y is because the act of recording by device 12 removes 

^=[1 2 0 the hidden data, which is the descrambling key. The 
goal of preventing recording has now been achieved. 

Thus Fig. 1C shows generally the intended result 
in accordance with this disclosure - that the "hidden" 
data in the scrambled analog video is not recorded, so 
25 any recording of that video results in a video signal 
that then cannot be descrambled, due to lack of the 
essential descrambling key which was not recorded. 
This in effect prevents unauthorized recording. A 
problematic recording device 13 as in Fig. IB in 
30 contrast, if available, would record the hidden data 

and thereby pass it along to the display device 18 upon 
playback. 

Other suitable data hiding methods (in addition to 
placement in the blanking intervals) include (1) use of 
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a high frequency carrier that is within the 
transmission bandwidth of the video cable but is 
outside the bandwidth of the recording device; and (2) 
phase modulation of the video signal's synchronization 
5 pulses, as described in the above-referenced copending 
application. Versions of all of the above methods may 
be applied to a chrominance signal as well as a 
luminance signal . 

For high definition television as opposed to 
10 NTSC/PAL video, the above -described use of any part of 
the blanking intervals to hide the data method may be 
□ inadequate since high definition video recorders have 

yet to be made commercially available. These recorders 
h2 may be newly designed to record the active picture area 

.: a:, 

; _;{ 

'-^ 15 and also the horizontal and vertical blanking 

UJ intervals; this would include any conventionally 

encoded data in the vertical blanking intervals. These 

Q types of recorders may, for instance, record that part 

of the video signal (including blanking intervals) 

Ml 20 which goes from blanking (or black) level to peak white 
level, with some margin for overshoots. For instance, 
the CCIR-601 standard defines an 8 -bit number system 
for carrying a digital component video signal in which 
the black level is represented by level 16 of 256 
25 possible levels (10 hex ) and white is represented by 

level 235 (EB he x) • In this case, levels from 1 to 254 
(Olhex to FE hex ) are considered legal while levels 0 and 
255 (OOhex and FF hex ) are reserved for the transmission 
of synchronization words. 
30 An analog representation of such a conventional 

(prior art) high definition video signal waveform is 
shown in Fig. 2 with the associated voltage levels 
indicated both as voltages (right margin) and as 
digital values (left margin) . Fig. 2 shows one video 
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line (with no actual picture information) and the 
beginning of the next video line, thereby including two 
horizontal sync pulses. 

One method for accomplishing the present data 
5 placement which would be operative with such standard 
video recorders is to locate the data signals in a part 
(in terms of amplitude) of the video signal which is 
generally reserved for the synchronization (sync) 
pulses, i.e., from blanking or black level down to the 
10 sync tip level. This is outside the amplitude range 
recorded by the above-described potential HD video 
□ recorders. For instance, a PAL video signal having 

: S blanking at 0 volts has sync tip at -300 millivolts. 

Q Or, for instance a 525 progressive, 720 progressive, 

Jig 15 1080 interlaced or 1080 progressive analog component 
Ul video signal (HDTV) conforms to the EIA-770 standard 

where blanking again is at 0V and the sync tips are at 
O -300 mV as shown in Fig. 2. The standard tri-level 

sync pulses for HDTV are shown in Fig. 2. 
20 This data hiding method is operative because a 

n 

=^ corresponding digital component video signal (e.g., 

conforming to CCIR-601, SMPTE 274M, 293M or 296M) is 
only able to represent those parts of the analog video 
signal down to approximately -48 mV (01 hex) . (This 

2 5 presumes that at some point in the recording device, 

the video signal is digitized, of course.) Analog 
video levels below this are clipped when digitized (see 
Fig. 2) and so must necessarily be represented (in the 
digital domain) simply as the smallest possible 

3 0 value, 01 hex (8 -bit) . Thus information in the analog 

video signal below -48mV is lost when converted to a 
CCIR-601 type signal's digital representation. 

Thus when this digital component video signal is 
converted back to analog form, it cannot create a 
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negative going pulse of sufficient amplitude. In most 
cases, in the digital video domain, it is the 
responsibility of a special integrated circuit to 
receive special synchronization words (values) and then 
5 to convert those into analog sync pulses with 

sufficient negative amplitude. Special sequences of 
FFhex and OOhex and an additional byte are often used to 
indicate the start of a line, field or vertical period 
or their end. Thus devices which convert the analog 
10 video to digital component video for internal recording 
or processing (e.g., certain video recorders), such as 
recording device 12 in Fig. 1C would inherently remove 
any hidden data encoded below the video blanking level. 
In particular, the data transmitted in this way is not 
15 generally available in a digital video format which 
LJ would be available for manipulation by software. This 

I " j inaccessibility by software considerably enhances a 

□ scrambling system. 

A For more detail see Fig. 3 which shows a waveform 

y 

: Rj 20 relating to that of Fig. 2 but showing multiple video 
i~ lines including (upper part of figure) the vertical 

blanking interval of a conventional analog component 
video signal in accordance with the EIA-770.1 HDTV 
standard. The lower part of Fig. 3 shows (hatching) 
25 for that same waveform possible data hiding locations 
in accordance with this disclosure. The illustrated 
data hiding locations are all below blanking level and 
in the VBI . Fig. 3 is for the luminance component of a 
video signal. The data itself may be encoded in any 
30 convenient digital communications format consistent 
with the general representation shown in Fig. 4. 
Fig. 3 shows (hatched areas) possible locations in the 
VBI for the data packets shown in Fig. 4. 
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Thus Fig. 3 shows (lower part) how the vertical 
blanking interval is used to place data (hatched areas) 
that would not be recorded both because it is in the 
VBI (or HBI) and because it is below the blanking 
5 level. Some digital recorders reproduce the VBI, but 
none reproduce below blanking level . 

Fig. 4 shows an example of the conventional Fig. 2 
video line with data added in accordance with this 
disclosure and thus corresponds to one of the hatched 
10 areas in Fig. 3 with the proceeding and following sync 
pulses. In this case the line is in the VBI (see Fig. 
3) , and an example representing an 8 -bit hidden data 
"payload" having the value of 0001 0100 (in binary) is 
shown as being alterations to the usual horizontal sync 
15 pulses present in this line of the VBI. Note that the 
Lyi digital representation of this line includes some 

values at the following hex values: 10 , samples 
ramping down to 01 # the remainder of the line at 01, 
samples ramping up to 10, 10. The analog signal levels 
20 below the digitization threshold (01 hex here) are 

clipped when digitized. The clipped values of course 
are thereby removed (not recorded by a standard 
recorder which carries out the digitizing) . 

Fig. 5 shows a block diagram of a conventional 
25 video encoder which may be an IC (integrated circuit) 

that converts Y, Cb, Cr, and sync multiplexed component 
video to Y, Pb, Cr component video. Such an encoder is 
used in a cable TV set top box or a video recorder. In 
some cases, these IC's have 6 digital-to-analog 
30 converters: composite (NTSC or PAL), S-Video (luminance 
and chrominance) and component video (Y/Pb/Pr or GBR) . 
Fig. 5 shows a three component DAC (having digital - 
analog converters 4 0a, 4 0b, 4 0c) version. 
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The Fig. 5 digital encoder includes an 
illustrative input multiplexed component video bus 30 
carrying the Y, Cb, Cr, and sync video components to 
the input port of demultiplexer and video sync 
5 generation circuit 34. The resulting output component 
video from demultiplexer 34 is subject to sync 
processor 3 8 which adds the sync component into the Y 
component. The resulting Y, Cb, Cr components are 
converted back to analog video components Y, Pb, Pr by 
10 respectively digital to analog converters 40a, 40b and 
40c. 

□ Fig. 6 shows a modified version of the Fig. 5 

'~ encoder with the functionality to add the encoded data 

Q as additional sync pulses in the VBI as shown in 

m 15 Fig. 4. The Fig. 6 encoder additionally includes a 
LJI timing and video sync generation circuit 44 . Circuit 

44 includes shift registers 45a supplying serial data 
Q to the input terminal of a pulse shaping filter 45b. 

Ljjj Circuit 44 in turn is coupled to data registers 

5 s nj . 20 (memory) 48 which receives the data to be hidden on its 
input port 46, for insertion into the VBI portion of 
the video signal. 

The complementary decoder (installed, for 
instance, in a compliant display device 18 in Fig. 1C) 
25 receives the modified video signal transmitted from the 
Fig. 6 encoder, extracts the added data signal, and 
separately supplies the video and the extracted data 
to, e.g., a descrambler, where the extracted data is 
used as the descrambling key. 
30 The above-mentioned alternative method of placing 

data in a video signal using a high frequency carrier 
to "hide" the data can be understood with reference to 
Fig. 7A. In general, video recorders either use 
sampling of the video before recording or have some 
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limited bandwidth over which they are capable of 
recording analog information. Fig. 7A shows video 
signal frequency (horizontal axis) vs. signal amplitude 
(vertical axis) . Generally, video transmission media 
5 such as coaxial cable has a wider bandwidth than do 
standard recording devices . 

As shown in Fig. 7A, the data is converted to a 
format in which all of the energy is concentrated in a 
higher region of the spectrum (indicated in Fig. 7A as 
10 fdata) and transmitted at the high frequency band fdata to 
which the recorder cannot respond (record) because of 

j its inherent data storage limitations. (Storage 

~, 

S! capacity is always a finite resource which must be 

=» 

3 conserved.) Thus, this allows for data to be presented 

^ 15 to the recorder over the transmission media so the 
l| recorder cannot record it. As described above, this is 

::J desirable for preventing recording of certain types of 

3 hidden data. Clearly, to be useful, a compliant video 

device, (e.g., a TV set) must be able to respond to the 
HI 20 video signal at carrier frequency fdata/ and therefore 
~ must include appropriate data demodulators. Suitable 

demodulator techniques are well known. 

Fig. 7B shows such an encoder suitable for 
carrying out the technique of Fig. 7A. This encoder 
2 5 typically is present in the source device, such as a 

set top box or video player 14 of the type in Fig. 1C. 
Incoming video, which is standard video, is applied at 
terminal 52 . Note that this encoder is typically used 
for each video component where the data is to be 
30 inserted. Note that typically the added data would 
only be applied to one component of the video. Any 
necessary analog to digital or digital to analog 
conversion is not shown but is conventional. 
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The incoming video applied at terminal 52 is 
coupled at node 54 to conventional sync separator 56. 
The incoming video at node 54 is also applied to one 
input terminal of summer 78. The horizontal and 
5 vertical separated blanking pulses (in the digital 

domain) from sync separator 56 are then applied to the 
load/shift control terminal of conventional shift 
register 60. At the same time the incoming data (which 
is, e.g. a descrambling or decryption key), and which 
10 is generated externally by any one of a number of the 
usual methods, is applied as a parallel multi-bit 
□1 signal to input terminal 62 which is the input terminal 

h i to a buffer 64 . 

Q The output signal from buffer 64 is then parallel 

;:Jj 15 data applied to the parallel in terminal of shift 

LJ register 60. This input data, in response to the 

r fit 

' ' applied horizontal and vertical blanking pulses, is 

Q output as serial out data to one input terminal of a 

modulator 68. The other input terminal of modulator 68 
Lnj 20 is coupled to an oscillator 70, operating at frequency 
fdata- Modulator 6 8 is any suitable type of modulator, 
using for instance FM, AM, FSK, PSK, QPSK, etc. The 
modulated serial data output from modulator 68 is then 
applied to the other input terminal of summer 78 which 
2 5 outputs the combined input video and the above -band 
data on its output terminal 80. 

The complementary decoder, which is typically 
present in a compliant display device (TV set) 18 of 
the type in Fig. 1C, is shown in Fig. 7C. The input 
30 video and data, which is essentially the same signal as 
output on terminal 80 of the Fig. 7B encoder, is 
applied at the input terminal 90. This video and data 
combined signal is then coupled to an optional low pass 
filter 96 and output as the output video at terminal 
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100. At the same time the input video at terminal 90 
is applied to, at node 92, the input terminal of 
conventional sync separator 94. Again, any needed 
analog to digital or digital to analog conversion is 
5 not shown but is conventional. The input video is 

typically only one component of component video, but it 
is the component carrying the data. 

The signals output from the sync separator 94 are 
the horizontal and vertical blanking pulses applied to 
10 the shift/load control terminal of shift register 112. 
At the same time, the input video and data signal at 
C3 terminal 90 is applied to the input terminal of band 

"% pass filter 104, which outputs the filtered signal to 

it as, 

••3 the input terminal of demodulator 110. Demodulator 110 

15 is complementary to modulator 68 in the encoder of 

LlJ Fig. 7B. The other input terminal of demodulator 110 

i: - is coupled to an oscillator 106 outputting signals at 

i;5 frequency fdata/ which of course is predetermined to 

i A, 

match that of the encoder. 
Lnj 2 0 The resulting serial data output from demodulator 

;;i 110 is applied to the serial input terminal of shift 

Us! 

register 112, which then outputs, in response to the 
control signals applied at its shift/load terminal, the 
output parallel data to the input terminal of buffer 

25 118. Buffer 118 then outputs the separated output data 
needed for, e.g., descrambling on its terminal 120. 
Thus the compliant device has, respectively, the video 
on terminal 100 and the data (descrambling key) on 
terminal 12 0 and is able conventionally to perform the 

30 descrambling by whatever algorithm is associated with 
the scrambling technique. 

While the above methods are for the most part 
modifications to the luminance video signal component, 
they also apply to the chrominance video signal 
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component. The chroma component (e.g., Cr, Cb) are 
baseband signals just as is the luma component. As 
such they can be modified or added to in the same ways 
as can the luma component. In particular, they contain 
VBI and HBI portions; while they do not normally 
include sync pulses as such, nothing says they could 
not have pulses added. In addition, chrominance 
components could also have high frequency components 
added in a manner as shown in Fig. 7A. 

Another method of conveying data in a "hidden" 
(non-recordable) manner is to modulate the position of 
the conventional sync pulse edges over time. Most 
digital video recorders do not record the horizontal 
synchronization signals; instead, they extract low 
frequency timing information from them and regenerate 
and reinsert it upon playback. Creation of a phase 
modulated synchronization signal allows for information 
to be conveyed across the transmission media which is 
not recorded by the recording device. (This is the 
method of the above-referenced co-pending application 
of Ryan, et al . ) 

Fig. 8A shows a conventional tri- level sync pulse 
for HDTV, as also shown in Fig. 2. In Fig. 8B, the 
sync pulse of Fig. 8A is modified in accordance with 
this disclosure so that the rising edge of the modified 
tri -level sync pulse remains in the same nominal 
position, while the falling edges that precede it and 
follow it are modulated - advanced in time. Similarly, 
in Fig. 8C, the two falling edges at the modified sync 
pulse are delayed in time. A code system of this type 
can convey, using the modulated edge positions, the 
descrambling key to a suitable decoder to allow 
descrambling of the accompanying video signals, or to 
convey other information, using the differences between 
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these types of sync pulses. That is, the modulated 
edge positions represent the descrambling key value. 
This is the sync edge modulation technique disclosed in 
the above-referenced patent application. 
5 Further modifications will be apparent to one of 

ordinary skill in the art in light of this disclosure. 
Therefore, the above description and illustrations 
should not be construed as limiting the scope of the 
invention, which is defined by the appended claims. 
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